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Abstract 

Cognitive functions are stored in the connectome, the wiring diagram of the brain, which exhibits non-random features, so- 
called motifs. In this work, we focus on bidirectional, symmetric motifs, i.e. two neurons that project to each other via 
connections of equal strength, and unidirectional, non-symmetric motifs, i.e. within a pair of neurons only one neuron 
projects to the other. We hypothesise that such motifs have been shaped via activity dependent synaptic plasticity 
processes. As a consequence, learning moves the distribution of the synaptic connections away from randomness. Our aim 
is to provide a global, macroscopic, single parameter characterisation of the statistical occurrence of bidirectional and 
unidirectional motifs. To this end we define a symmetry measure that does not require any a priori thresholding of the 
weights or knowledge of their maximal value. We calculate its mean and variance for random uniform or Gaussian 
distributions, which allows us to introduce a confidence measure of how significantly symmetric or asymmetric a specific 
configuration is, i.e. how likely it is that the configuration is the result of chance. We demonstrate the discriminatory power 
of our symmetry measure by inspecting the eigenvalues of different types of connectivity matrices. We show that a 
Gaussian weight distribution biases the connectivity motifs to more symmetric configurations than a uniform distribution 
and that introducing a random synaptic pruning, mimicking developmental regulation in synaptogenesis, biases the 
connectivity motifs to more asymmetric configurations, regardless of the distribution. We expect that our work will benefit 
the computational modelling community, by providing a systematic way to characterise symmetry and asymmetry in 
network structures. Further, our symmetry measure will be of use to electrophysiologists that investigate symmetry of 
network connectivity. 
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Introduction 

It is widely believed that cognitive functions are stored in the so- 
called connectome [1,2], the wiring diagram of the brain. Due to 
improvements in technology, experimental techniques and com- 
putational paradigms [3,4], the investigation of the connectome, 
known as connectomics , has generated great excitement [5] and 
has made significant progress [6-9] resulting in a rapid 
proliferation of neuroscience datasets [10—13]. 

Studies on the brain wiring diagram have shown that connectivity 
is non-random, highlighting the existence of specific connectivity 
motifs at the microcircuit level, see for instance [14—17]. Of particular 
interest are the motifs that exhibit bidirectional (reciprocal) and 
unidirectional (non-reciprocal) connections between pairs of neurons. 
More specifically, theoretical work [18] studied the development of 
unidirectional connectivity due to long-term plasticity in an artificial 
network of spiking neurons under a temporal coding scheme, where it 
is assumed that the time at which neurons fire carries out important 
information. This finding is correlated to unidirectional connectivity 
observed in somatosensory cortex, see [19]. In [18] the development 



of bidirectional connectivity in the same network under a. frequency 
coding scheme, where information is transmitted in the firing rate of 
the neurons, was also studied and correlated to bidirectional 
connectivity found in the visual cortex [14]. Complementary to this 
work, in [20,21] the authors explored the experimentally identified 
correlation of bidirectional and unidirectional connectivity to short- 
term synaptic dynamics, see [22], by studying the development of 
connectivity in networks with facilitating and depressing synapses due 
to the interaction of short-term and long-term plasticities. The role of 
synaptic long-term plasticity in structures formation within networks 
has been also investigated in [23-25]. 

Similar to [18] and [20,21], we hypothesise that the above 
mentioned motifs have been shaped via activity dependent synaptic 
plasticity processes, and that learning moves the distribution of the 
synaptic connections away from randomness. Our aim is to provide 
a global, macroscopic, single parameter characterisation of the 
statistical occurrence of bidirectional and unidirectional motifs. To 
this end: 
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1 We define a symmetry measure that does not require any a 
priori thresholding of the weights or knowledge of their 
maximal value, and hence is applicable to both simulations 
and experimental data. 

2 We calculate the mean and variance of this symmetry measure 
for random uniform or Gaussian distributions, which allows us 
to introduce a confidence measure of how significantly 
symmetric or asymmetric is a specific configuration, i.e. how 
likely it is that the configuration is the result of chance. 

3 We demonstrate the discriminatory power of our symmetry 
measure by inspecting the eigenvalues of different types of 
connectivity matrices, given that symmetric matrices are 
known to have real eigenvalues. 

4 We show that a Gaussian distribution biases the connectivity 
motifs to more symmetric configurations than a uniform 
distribution and that introducing a random synaptic pruning, 
mimicking developmental regulation in synaptogenesis, biases 
the connectivity motifs to more asymmetric configurations, 
regardless of the distribution. Our statistics of the symmetry 
measure allows us to correctly evaluate the significance of a 
symmetric or asymmetric network configuration in both these 
cases. 

5 Our symmetry measure allows us to observe the evolution of a 
specific network configuration, as we exemplify in our results. 

We expect that our work will benefit the computational 
modelling community, by providing a systematic way to 
characterise symmetry and asymmetry in network structures. 
Further, our symmetry measure will be of use to electrophysiol- 
ogists that may investigate symmetric or asymmetric network 
connectivity. 

Methods 

In what follows, we first define a novel measure that quantifies 
the degree of symmetry in a neuronal network with excitatory 
synaptic connections. More specifically, we describe the strength of 
the synaptic efficacies between the neurons by the elements of a 
square matrix, i.e. the connectivity matrix, to which we associate a 
number that quantifies the similarity of the elements above the 
matrix diagonal to those below the diagonal. We further study this 
measure from a statistical point of view, by means of both 
analytical tools and numerical simulations. Aiming to associate a 
significance value to the measure, i.e. the probability that a certain 
symmetric or non-symmetric configuration is the result of chance, 
we consider random synaptic efficacies drawn from uniform and 
Gaussian distributions. We also study how our symmetry measure 
is affected by the anatomical disconnection of neurons in a 
random manner, i.e. zeroing some entries in the connectivity 
matrix. Finally, we anticipate that connectivity distributions are 
modified by activity-dependent processes and we describe the 
structure of the network we use as a demonstrative example in the 
Results section. 

Definitions 

Let us consider the adjacency (or connectivity) matrix W of a 
weighted directed network [26], composed of N vertices and 
without self-edges. The N vertices represent the neurons, with 
N(N —I) possible synaptic connections among them. The 
synaptic efficacy between two neurons is expressed as a positive 
element Wjt in the adjacency matrix. W is thus composed by 
positive elements off-diagonal, taking values in the bounded range 
[0,w'ma.v], and by zero diagonal entries. We define s as a measure of 
the symmetry of W: 



N(N-\)-2M 



E E 

/=!. / = /+! 



where M is the number of instances where both w« and Wk are 
zero, i.e. there is no connection between two neurons. The term 
N(N-\)-2M 



'1- 



is a normalisation factor that represents the 



total number of synaptic connection pairs that have at least one 
non-zero connection. A value of s near 0 indicates that there are 
virtually no reciprocal connections in the network, while a value of 
s near 1 indicates that virtually all connections are reciprocal. We 
exclude (0,0) pairs from our definition of the symmetry measure. 
Mathematically such pairs would introduce undefined terms to Eq. 
(1). In addition, conceptually, we expect that small weights will not 
be experimentally measurable. It is then reasonable to exclude 
them, expecting to effectively increase the signal to noise ratio. 

Pruning and Plasticity. We assume that a connection Wy is 
permanently disconnected and set to 0 with probability 
p pmning = a e [0, 1). Consequently, the probability that two 
neurons i and j are mutually disconnected, i.e. = Wjj = 0, is 
a 2 . When a connection is permanently pruned in such a way, its 
efficacy remains 0 all the time, whereas the off-diagonal non- 
pruned values of the adjacency matrix W change slowly in time, as 
a result of activity-dependent synaptic plasticity. We consider that 
this procedure correlates with developmental mechanisms associ- 
ated with or following synaptogenesis. 

Unidirectional and Bidirectional connection pairs. We 



associate the quantity Z« 



i.e. the term of the 



summation in the Eq. (1) to the neuronal pair ij. This term maps 
the strength of the connections between two neurons to a single 
variable. Each connection pair can therefore be bidirectional if 
Wy — Wji, unidirectional if Wij«Wjj or Wyy>Wji, or none of the two. 
As a consequence, a network can be dominated by bidirectional 
connectivity, by unidirectional connectivity, or it may exhibit 
random features. 

Weight Bounds. In what follows we consider the case of 
|w// — w«\ 

w m ax = 1 • E)ue to the term — : — , this can be done without loss 

Wij + Wji 

of generality. 

Statistics of s 

Let us consider a large number of n instances of a network 
whose connection weights are randomly distributed. Each 
adjacency matrix can be evaluated via our symmetry measure. 
We rewrite Eq. 1 as: 



EE 

i=\j=i+\ 



E z '- 



(2) 



where A; is a linear index running over all the q non-zero 
"connection pairs" within the network. We can then estimate the 
mean /x s and variance a 2 of s over all n networks as: 



H s = E n [s] = \-E n [Z] 



ffj 2 = Var„(5)=-Var„(Z) 



(3) 



(4) 
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where the notation E„[-] and Var„(-) implies that the expected 
value and variance are computed along the n different represen- 
tations of the network. 

Eq. (3), (4) allow us to transfer the statistical analysis from s to Z. 
To derive theoretical formulas for mean value and variance of Z 
we use the fact that its probability density function (PDF), /(Z), 
can be written as a joint distribution, f{Z\ ,Z 2 ) where we have 
introduced the notation Z\ = \wy — Wjj\, Z2 = Wfl + Wj, : 



E[Z] = 



dZZf(Z)-- 



dZ l dZ 2 ^f(Z l ,Z 2 ) (5) 

D Z 2 



within the range D defined by 0 < Z\ < 1 and Z\ < Z 2 < 2 — Z\ . 
Similarly, we can calculate the variance as follows: 



Jo 



Var(Z)= dZ (Z-E[Z]) f(Z) 



(6) 



^ dZ x dZ 2 ^1-E[Z]J f(Z u Z 2 ). 



f:(w) = (l-a)f(w) + aS(0). 



(10) 



Now the (0, 0) pairs have to be explicitly excluded from the 
distributions of Z\ and Z 2 . Also, the number of pairs of the type 
(w, 0) increases, resulting in the appearance of a uniform 
contribution in the region [0, 1] in both the PDF of Z\ and Z 2 . 
Their final exact profile can be obtained by considering the 
possible combinations of drawing Wy and Wji from the above 
pruned distribution and their corresponding probability of 
occurrence. There are four contributions: f(w) x f(w), 
f(w)xS(0), S(0)xf u (w), <5(0) x <3(0). The last term, which 
describes the (0, 0) pairs, has to be subtracted and the remaining 
expression has to be renormalised. The results are graphically 
shown in Fig. IF, 1G and are mathematically described by the 
following expressions: 



l-a 2 
l+a l+ l+a 



for 
otherwise 



Z, e [0, 1] 



(11) 



We note that mean value and variance of Z can be numerically 
estimated either by using a large set of small networks or on a 
single very large network: What matters is that the total number of 
connection pairs, given by the product n-q, is sufficiently large to 
guarantee good statistics and that connection pairs are indepen- 
dent of each other. In the calculations below, we assume a very 
large adjacency matrix. 



fla(Z2) = 



I— a 2a 
l+a l+a 



for Z 2 e [0, 1] 



- l T -^Z 2 + 2 1 —^ for Z 2 e[l,2] 
l+a l+a 

, 0 otherwise 



(12) 



Adjacency matrix with uniform random values 

We first consider a network with randomly distributed 
connections without pruning, followed by the more general case 
where pruning is taken into account. 

Fully connected network. For the uniform distribution 
f(w)=l for we[0, 1], see Fig. 1A. The probability of having 
Wy = w« = 0 for at least one pair (i, j) is negligible, hence M = 0. It 
is straightforward to derive the distributions / 2 "(Z 2 ) and f"(Z\), 
depicted in Fig. 1B,C correspondingly: 



The joint PDF is a mixture of two uniform distributions: the 
unpruned distribution f" 2 (Z\, Z 2 ) and the contribution from the 
pruning, fl^Zi, Z 2 ), which is a delta peak along the line 
Zj=Z 2 , see Fig. 1H. To obtain f"(w), the two unitary 
distributions are mixed with some coefficients c 2 and C\ , satisfying 
the normalisation condition C\ + c 2 = 1 . With the same arguments 
used for f" a (Z\) and/J^Z^, we can derive the relation between 
C\ , c 2 and a, so that we can finally write: 



f"{Zi) 



-{■ 



-2Zi+2 for Zi e [0, 1] 
otherwise 



(7) 



f? 2 jz u z 2 )= C] f? 2 (z u z 2 )+c 2 f; eak (z u z 2 ) 

= 77— + -7-7— <5(Zi -Zi) for [Z U Z 2 ] e D. ^ 
l+a l+a 



Z 2 for Z 2 e [0, 1] 

J 2 "(Z 2 )={ -Z 2 + 2 for Z 2 e[\,2}. 
0 otherwise 

We can therefore obtain the joint PDF (Fig. ID): 
1 for [Z u Z 2 ]eD 



/ 12 (Zi,Z 2 ) = 



0 otherwise 



(8) 



(9) 



Expected value and variance of Z. We can calculate mean 
value and variance of Z by plugging Eq. (13) into Eqs (5) and (6): 



Var"(Z)=l- 



E"[Z] = |- fl (21n2-l)+^ 
l+a l+a 



81n2(l-a)+7a-5 /2(1 -a) (I - In 2) 



l+a 



l+a 



(14) 



1(15) 



Pruning. Introducing pruning to the elements of the adja- 
cency matrix, with probability a, corresponds to a discontinuous 
probability distribution function of w, that can be written as a sum 
of a continuous function and of a Dirac's Delta centred in w = 0 
(see also Fig. IE): 



Expected value and variance of s. By combining the above 
results with Eqs (3) and (4), we can derive the final formulas for the 
expected value and variance of s : 

,^P W = l-^(21n2-l)- 1 f fl (16) 
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Figure 1. Probability density functions for the case of uniformly distributed connections. A Distribution of the uniform variable w. B 
Distribution of the sum Z 2 of two uniform variables. C Distribution of the absolute difference Z\ of two uniform variables. D Joint distribution of Z 2 
and Z\. E, F, G The same as A, B and C but with pruning a = 0.1. H The same as D but with pruning a = 0.01. In all figures, Grey shaded area: 
histograms from simulations, Black lines and surfaces: theoretical results (see Eq. (7)-(13)). 
doi:10.1371/journal.pone.0100805.g001 
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(o^sEVai-fc) 



1- 



81n2(l-a) + 7a-5 /2(1 -a) (I - In 2) 



1+a 



1+a 



(17) 



Adjacency matrix with Gaussian-distributed random 
values 

The procedure described above to derive the joint PDF of Z\ 
and Z 2 is applicable to any distribution. In what follows, we 
consider a network with initial connections drawn by a truncated 
Gaussian distribution. 

Distribution of connections. Whereas the uniform distri- 
bution is well defined in any finite interval, the Gaussian 
distribution requires some considerations. Strictly speaking, any 
Gaussian distribution is defined over the entire real axes. For 
practical reasons, however, for any finite network N<co, the 
maximum and the minimum values of the weights, 

Wmax and Wmini 

are always well defined, and therefore the actual distribution is a 
truncated Gaussian. To be able to consider the truncated Gaussian 
distribution as Gaussian with satisfactory accuracy, we require that 
the portion of the Gaussian enclosed in the region [w min , w max ] is 
as close as possible to 1 . This means that the distribution has to be 
narrow enough with respect to the interval of definition 
[w m ;„, w max \. Also, by definition, the distribution has to be 
symmetric in [w min , w max ]. Because we are considering only 
excitatory connections then w mi „ = 0, so as the mean value has to 

be Hyf = • On the other hand, the narrowness imposes a 



the standard deviation 
. Since we can set w ma 



of the distribution: 
. = 1 without loss of 



condition on 
a w «Aw = w mal 

generalization, the entire study on all the possible Gaussian 
distributions can be limited to a special class, @(n=-^, a 1 

The choice of a. To guarantee a good approximation of a 
Gaussian distribution, we define the truncated Gaussian distribu- 
tion such that points within 5a fall in [0, 1] leading to a w = — and 

a truncation error e tr = 1 — [J J\f(w) dw ~ 10~ 4 . 

Fully connected network. For the truncated Gaussian 
distribution defined above, the distribution of connections without 
pruning is (see also Fig. 2A): 



1 



V2tt 0.1 2 



exp 



(vc-0.5)' 
2x0.1 2 



(18) 



for w e [0, 1] 



where M denotes the normal distribution. Since combinations of 
Gaussian distributions are also Gaussian distributions, we can 
immediately derive the PDF of Z 2 and Z* = w, 



•J~ W J'- Then, 



ff{Z\) is simply the positive half of f* g (Z\), but scaled by a factor 
of two because of the normalization. We obtain (Fig. 2B,C): 

/f(Zi)=JVi /2 (Zi; ^=0, ffi=-s/2 ffw ) forZi e [0, 1] (19) 



Jl (Z 2 ) =N (z 2 ; hi = 2ft,, <J2 = V2 ff „.) for Z 2 e [0, 2] (20) 

where A/" 1/2 identifies the normalised (positive) half of a normal 
distribution. Similarly, the joint distribution /j^(Zi,Z 2 ) can be 
easily derived from the bivariate Gaussian of Z\ and Z 2 (Fig. 2D): 

/f 2 (Zi,Z 2 ) =Ny 2 (z u Z 2 ; /< 1>2 ,X 1>2 ) ^ 

with A/"f/ 2 being the normalised half (where Z\ > 0) of a bivariate 
normal distribution. 

Pruning. When taking pruning into account, each PDF can 
be considered as a mixture of the unpruned distribution and the 
contribution coming from the pruning. We can therefore write: 



P a (w) = {\-a)N{ W ; fi w , a w ) + ad(0), 



1+a 



2a 
1+a 



(22) 



(23) 



N(w; n w , a w ) forZi e [0, 1] 



/| a ( Z 2)=^-^(Z 2 ; n 2 , a 2 ) + 



2a 
1+a 



(24) 



N(w; n w , a w ) forZ 2 e [0, 2] 



The above distributions are plotted in Fig. 2E, 2F, 2G. 

Finally, the joint PDF is again a mixture model, with a 
univariate Gaussian peak profile on the line Z\ = Z 2 (Fig. 2H). 
Note that this peak can be described by the intersection of the 
plane Z\ = Z 2 with the full unpruned bivariate normal distribution 
JV B transformed to have its mean in (fi w ,fi w ). This operation 
implies a re-normalisation by 2=(4na 2 ) of the resulting 
univariate Gaussian. Then, we can write: 

fnJZu Z 2 ) = < /2 (z u Z 2 ; ft>2 , J^j 

+ XTa\ MB ( Zl > Z2; "">»• 5) S(Zl ] 
for [Z u Z 2 \eD 

Correlation in the bivariate Gaussian. The correlation p 
between Z\ and Z 2 , appearing in the off-diagonal terms of Si 2 > 
can be computed by running a numerical simulation. We 
estimated p as a mean value over 10 5 representations of a 10- 
neuron network with random connections distributed according to 
J\f{w; fi w , a w ) and with no pruning, i.e. a = 0. The result is 
p~7x 10~ 4 , which allows to treat Z\ and Z 2 as independent 
variables and then to factorise the bivariate normal distribution 
Eq. (21) in the product of the two single distributions. Indeed, by 
introducing the Heaviside step function Q(x) and the re- 
normalisation parameter R = 2, we can write: 
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Figure 2. Probability density functions for the case of Gaussian-distributed connections. A Distribution of the Gaussian variable w. B 
Distribution of the sum Z 2 of two Gaussian-distributed variables. C Distribution of the absolute difference Z\ of two Gaussian-distributed variables. D 
Joint distribution of Z 2 and Z\. E, F, G, H The same as A, B, C and D but with pruning a = 0.1. In all the figures, Grey shaded area: histograms from 
simulations, Black lines and surfaces: theoretical results (see Eq. (19)-(25)). 
doi:10.1371/journal.pone.0100805.g002 
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1/2 



(z 1; Z 2 ; ft la , J^j 



= RU B (z u Z 2 - ^^©(Zi-ai,) (26) 
~RM{Z V , n u ffi)7V(Z 2 ; Hi, o 2 )®{Zi-Hi) 
= A/"i/ 2 (Zi; ^, <ri)J\f(Z 2 ; Hi, ff i) ■ 



We note that the pruning case does not require a different 
calculation and can be treated as the a = 0 case. This is because we 
are describing the effect of the pruning with a separate (univariate) 
function, i.e. the halved bivariate normal distribution describes 
only the unpruned part of the network, see Eq. (25). 

The suitability of this approximation is also certified by 
Fig. 2D,H, where the agreement between simulation results and 
theoretical fit with Eq. (26) is excellent. 

Expected value and variance of Z. Now we can insert the 
expression of the joint distribution, Eq. (25), into Eq. (3) and Eq. 
(4): 



E g [Z] ■■ 



I— a 
1+a 



dZ\ Z\ 



l 



clZ 2 i- N B y2 {Zi , Z 2 ; Mh2 , J] j + 2<i 



(27) 



1+a 



+ ^I <iz ' (1 - ESIZI)2 ^( z " zl; ^s 



(28) 



To calculate the above expression we use symbolic integration. 
Expected value and variance of s. By plugging the above 
results into Eq. (3), (4), we obtain: 



1-a f 1 

o 

1 .r B 



dZi^M B l2 \Zu Z 2 ; fi h2 , Yj j ~ ^ 



(29) 



2a 1 



The four formulas Eq. (16), (17), (29), (30) are the final result of 
the statistical analysis and they will be discussed in the Results 
section. 

Model network with plastic weights 

Below we describe the model neural network on which we will 
apply our symmetry measure. 

Single-neuron dynamics. We simulated N = 30 leaky inte- 
grate-and-fire neurons [27] with a firing threshold of 



V t hr= —50 mV. The sub-threshold dynamics of the electrical 
potential V, is given by: 



dVt 



(VM-V^+RIiit), 



(31) 



where x m is the membrane time constant, V rest is the resting 
potential, R is the membrane resistance and 7j(f) is the input 
signal. We chose T ffl = 10 ms, V resl = -70 mV, R=\ KQ.. To 
introduce noise in the firing process of neurons, we implemented 
the escape noise model [28] . At each time-step At the probability 
that the neuron i fires is given by: 



Pd,{ V t ) = 1 - exp ( - At Po exp 



Vt-Vth 
AV 



(32) 



where p o = 0.l ms~ l and AV = 5 mV. Once a neuron fires, its 
membrane potential is reset to the resting value. 

Synaptic and External Inputs. The input Ij(f) to each 
neuron has two components: a synaptic part, coming from the 
action potentials of the other neurons, and an external part, which 
is defined by the applied protocol: 



m=ir(t)+ir'(t) 

= ^ n Y^ w ij&{t- tf j- e)+o: ex ^(f-ff 



(33) 



In the synaptic term, Wy are the synaptic weights, t- is the firing 
time of the presynaptic neuron j and e is a small positive number 
accounting for the delivering time of the electrical signal from the 
presynaptic to the postsynaptic neuron. The term tf" is the time 
course of the injected input, which is different from neuron to 
neuron and depends on the protocol we use (see Results section). 
Finally, the amplitudes <f yn and a ex ' are fixed to the same value for 
all neurons. We chose <x syn = 1 /iixj and <x ext = 30 x s, so 
that each external input forces the neurons to fire. 

Plasticity. The efficacy of the synaptic connections is activity- 
dependent. Therefore, the unpruned elements of the adjacency 
matrix Wy in Eq. (33) change in time by Spike-Timing Dependent 
Plasticity (STDP) mechanisms, i.e. passively driven by the input 
protocol and emerging internal dynamics, without the presence of 
a supervisory or reinforcement learning signal [29-31]. More 
specifically, we implemented the triplet STDP rule [18,32,33] with 
parameters from [32] (Visual cortex, nearest neighbour dataset), 
see Table 1, and we constrain the connections in [0, 1]. In this 
model, each neuron has two presynaptic variables r l , r 2 and two 
postsynaptic variables o , o 2 . In the absence of any activity, these 
variables exponentially decay towards zero with different time 
constants: 



l drj 2 



dr\ 

cfo[ 
dt 



'■O J 



' 2 dt 

1 d ° 2 i 



(34) 



whereas when the neuron elicits a spike they increase by 1 : 

rj-wj + l rj^rj + l o)^o\ + \ o 2 ^o 2 +\. (35) 



PLOS ONE | www.plosone.org 



7 



July 2014 | Volume 9 | Issue 7 | e100805 



Measuring Symmetry, Asymmetry and Randomness in Synaptic Connectivity 



Table 1. List of 


parameters used for the case study. 






Symbol 


Description 


Value 


N 


Number of neurons 


30 


tin 


Membrane time constant 


10 ms 


R 


Membrane resistance 


1 KP_ 


*re$t 


Resting and after-spike reset potential 


-70 mV 


V„, r 


Threshold potential for spike emission 


-50 mV 


rj -xyn 


Voltage increase due to a presynaptic event 


1 mV 


text 


Voltage increase due to an external event 


30 mV 




Lower bound for synaptic weights 


0 


»w 


Higher bound for synaptic weights 


1 




Mean value of Gaussian-distributed initial weights 


0.5 


CT„, 


Variance of Gaussian-distributed initial weights 


0.01 


A + 
A 2 


Amplitude of weights change - pair term in Long-Term Potentiation 


4.6 x 10- 3 


A + 


Amplitude of weights change - triplet term in Long-Term Potentiation 


9.1 x 10~ 3 


*1 


Amplitude of weights change - pair term in Long-Term Depression 


3.0 x 10- 3 




Amplitude of weights change - triplet term in Long-Term Depression 


7.5 x 10- 9 




Decay constant of presynaptic indicator n 


16.8 ms 


*n 


Decay constant of presynaptic indicator ri 


575 ms 




Decay constant of postsynaptic indicator o\ 


33.7 ms 




Decay constant of postsynaptic indicator 02 


47 ms 


7 


Learning rate for STDP 


{1.7} 


dt 


Discretisation time step 


1 ms 




Number of independent repetitions of the experiment 


50 


STDP parameters are as in the nearest-spike triplet-model, described in [32]. 
doi:1 0.1 371 /joumal.pone.01 00805.t001 



Then, assuming that neuron i fires a spike, the STDP 
implementation of the triplet rule can be written as follows: 



Wji^wji-y o)(t) fa +A^tj(t-e)] 
w v -*w v -y r){t) [A+ +A + oj(t-e)} 



(36) 



where y is the learning rate and £ is an infinitesimal time constant 
to ensure that the values of rf and o? used are the ones right before 
the update due to the spike of neuron i. The learning rate used is 1 
for the frequency protocol, 7 for the sequential protocol (see 
Results). 

Reproducibility of results. All simulations were performed 
in MATLAB (The Mathworks, Natick, USA). Code is available 
from ModelDB [34], accession number: 151692. 

Results 

We recall the definition of the symmetry measure s (Eq. 1): 



N(N ■ 



N N 
;=!/=;+! 



K-»>l 



(37) 



V 



where Wy is the positive synaptic connection from neuron j to 
neuron i, N is the total number of neurons and M is the number 

are zero, i.e. there is no 
N(N-\)-2M 

2 18 



of instances where both Wy and Wjj 



connection between two neurons. The term q- 



a normalisation factor that represents the total number of synaptic 
connection pairs that have at least one non-zero connection. 

By using this definition, we were able to estimate the expected 
value and the variance of s on random matrices (uniform and 
truncated Gaussian), see Eq. ( 1 6) — ( 1 7) and (29)-(30) correspond- 
ingly. This provides us a tool to estimate the significance of the 
"symmetry" or "asymmetry" of the adjacency matrix of a given 
network, shaped by learning, given the initial distribution of the 
synaptic connections prior to the learning process. The statistical 
analysis is particularly useful in cases where the developed 
configuration is not "clear-cut", i.e. all connections have been 
turned to either bidirectional or unidirectional resulting in a 
symmetry measure almost 1 or 0, which is probably an artificial 
scenario, but rather in the intermediate cases, where we need a 
measure of how far away the value of the symmetry measure of a 
specific configuration is from that of a random configuration. 
Though here we focused on two specific random distributions, our 
methodology is applicable to other distribution choices. 

Hypothesis test 

Having calculated the mean and variance of the symmetry 
measure s over random networks of a specific connectivity 
distribution, we are now able to directly evaluate the symmetry 
measure s s of a specific connectivity structure and conclude 
whether the symmetric or asymmetric structure observed is due to 
chance or it is indeed significant. A simple test is, for instance, to 
calculate how many standard deviations S s is away from ji s . 
Equivalently, we can form the hypothesis that the configuration s s 
is non-random and calculate the ^-value by: 
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Figure 3. Final statistics of the symmetry measure. A Expected value and standard deviation of the symmetry measure as a function of the 
pruning for different types of networks with uniform weights distribution. The total length of each bar is two times the standard deviation. Dashed 
light grey line: simulations for symmetric networks, Dash dotted light grey line: simulations for asymmetric networks, Solid dark grey line: simulations for 
random networks, Dashed black line: theoretical results for random networks. B The same as A but with Gaussian-distributed random weights. C 
Example of an adjacency matrix in a particular random network with uniform weights distribution and pruning parameter a = 0.4. For this example 
.s~0.260. D The same as C but with Gaussian-distributed random weights. For this example s~0.322. 
doi:10.1371/journal.pone.0100805.g003 



p — value = + 2 



N{n s ,a s )ds, 



where we implicitly assume that the distribution of the symmetry 
measure s over all random networks is Gaussian. We can compare 
(38) this result with the significance level we fixed, typically j?, = 0.05, 
and we can then conclude the nature of the symmetry of the 



Table 2. Mean value and standard deviation of the symmetry measure as obtained from the theoretical analysis. 





a 


fi" + a" 


/& + a& 


0.0 


0.614±0.042 


0.885±0.013 


0.1 


0.502 + 0.052 


0.724 ±0.053 


0.2 


0.409 ±0.056 


0.590 ±0.064 


0.3 


0.331 ±0.058 


0.476 ±0.070 


0.4 


0.263 ±0.058 


0.379 ±0.072 


0.5 


0.205 ±0.057 


0.295 ±0.072 


0.6 


0.153 ±0.056 


0.221 ±0.072 


0.7 


0.108 ±0.055 


0.1 56 ±0.071 


0.8 


0.068 ±0.053 


0.098 ±0.070 


0.9 


0.032 ±0.052 


0.047 ±0.068 









Column 1. Value of the pruning parameter a. Column 2. Uniform distribution. Column 3. Gaussian distribution. These values are obtained with n = 10 5 random networks 
of N = 10 neurons and are plotted in Fig. 3. 
doi:l 0.1 371 /joumal.pone.01 00805.t002 
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network with a confidence level equal to p s or reject the 
hypothesis. 

Pruning biases the network towards asymmetry 

To demonstrate the validity of our analytical results, we 
compare them to simulation results. We generated a sample of 
n = 10 5 networks with N = 10 neurons with random connections 
with synaptic efficacies varying from 0 to 1. We evaluated the 
symmetry measure on each network by applying directly the 
definition of Eq. (37), and then we computed the mean value and 
variance of that sample. This process was repeated ten times, each 
one for a different value of the pruning parameter, 
a = {0,0.1,0.2, . . .0.9}. The final results are shown in Fig. 3A,B, 
together with the analytical results, see Eq. (16) and Eq. (29). Since 
numerical and analytical results overlap, we used a thicker (black) 
line for the latter. The agreement between theoretical findings, 
listed in Table 2, and numerical evaluations is excellent. 

We also considered two extreme cases, symmetric and 
asymmetric random networks, which respectively represent the 
upper and lower bound for the symmetry measure defined in Eq. 
(37). Symmetric random networks have been generated as follows: 
we filled the upper triangular part of the N x N weights matrix 
with random values from the uniform/Gaussian distribution. We 
then mirrored the elements around the diagonal so as to have 
Wy = Wji. In the asymmetric case, instead, we generated a random 
adjacency matrix with values in [0.1, 1] for the upper triangular 
part and in 10~ 3 x [0.1, 1] for the lower triangular part, so as to 
have Wij«Wji. Then, we shuffled the adjacency matrix. 

In Fig. 3A,B we contrast our results on random networks with 
numerical simulations of symmetric and asymmetric random 
networks: the dashed, light grey line (top line) shows the upper 
extreme case of a symmetric random network Wy = Wfi 
Vz J = 1 . . . N , whereas the dash-dotted, light grey line (bottom 
line) shows the lower extreme case of a asymmetric random 
network Wj,«W/, for i>j. 

When we introduce pruning, the lower bound of s remains 
unchanged, whereas the more we prune the more a symmetric 
network appears as asymmetric. 



Gaussian-distributed synaptic efficacies bias the network 
towards symmetry 

In Fig. 3C,D, we show the adjacency matrix W for a random 
pruned network with pruning parameter a = 0.4. A network with 
uniformly distributed initial connectivity is shown in Fig. 3C and a 
network with Gaussian-distributed initial connectivity is shown in 
Fig. 3D. Black areas represent zero connection, Wy = 0. The 
"Gaussian" network has most of the connections close to the mean 
value n w , resulting in higher values for the symmetry measure than 
in the case of a uniform distribution, compare Fig. 3B with Fig. 3 A. 

This difference in the mean values of s depending on the shape 
of the distribution implies that for example a weight configuration 
that would be classified as non-random under the hypothesis that 
the initial connectivity, before learning, is uniform, is classified as 
random under the hypothesis that the initial distribution of the 
connections is Gaussian. To more emphasise this point, we show 
in Fig. 4 the adjacency matrix of two different networks of 30 
neurons. The first network, Fig. 4A, is a non-pruned network with 
0.900. According with the values obtained from the statistical 
analysis (Table 2), if we assume that the connections of this 
network are randomly drawn from a uniform distribution, the p- 
value test (Eq. (38)) gives us Rvalue ~ 6. 50 x 10~ 12 . With the usual 
confidence level of/)., = 0.05, this is a significant result, implying 
that the network configuration is unlikely to be random. On the 
other hand, if we assume that the initial connectivity is drawn from 
a Gaussian distribution, we obtain /(-value ^0.25, meaning that 
the network configuration should be considered random. 

In Fig. 4B, we show a pruned network with a = 0.2 and 
0.334. In this case the opposite is true: under the hypothesis of 
uniform random initial connectivity, the network should be 
considered random, as jf)-value^:0.18. Under the hypothesis of 
Gaussian-distributed random initial connectivity, the network 
should be considered asymmetric, as p-value ~7.20 x 10~ 5 . 

Relation between symmetry measure and motifs 

In what follows, we demonstrate the relation between our 
symmetry measure and unidirectional and bidirectional motifs. 
From the definition s, Eq. 37, we can deduct that in the extreme 
case of a network with unidirectional motifs, i.e. pairs of the form 
(0, x), x > 0, the symmetry measure will result in s = 0, while in the 




10 20 30 

Presynaptic neuron 




10 20 30 

Presynaptic neuron 



Figure 4. Symmetry and asymmetry depends on the distribution of the initial connectivity. A Example of an adjacency matrix in a 
random network with pruning parameter a = 0 and symmetry measure .?~0.900. According with the p-value test with the null hypothesis of random 
connectivity and with a level of confidence of 0.05, the symmetry of this network is significant if the distribution of the initial connections is uniform 
but is non-significant if the initial distribution of the connections is Gaussian. Therefore, in the first case it should be regarded as a non-random 
network whereas in the second case as a random network. B The same as A but with pruning parameter a = 0.2 and symmetry measure s~ 0.334. In 
this case, with the same hypothesis test, the situation is reversed: the network should be considered random for initial uniform distribution of 
connections, but non-random for initial Gaussian-distributed connections (see the discussion in the text). 
doi:10.1371/journal.pone.0100805.g004 
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Figure 5. Symmetry measure reflects motifs formation. A Scatter plot of fraction of unidirectional and bidirectional motifs as a function of the 
symmetry measure for 10 3 networks with uniform random connections and a = 0. Black dots: bidirectional motifs, Grey dots: unidirectional motifs. For 
this typology /i"- 0.614. BThe same as A but with pruning parameter a = 0.4. In this case 0.263. C Mean value and standard deviation (each bar 
is twice the standard deviation) of fraction of unidirectional and bidirectional motifs as a function of the symmetry measure for 10 3 networks with half 
of the connections uniformly distributed and a = 0. The second half of the connections were derived from the values of connection pairs Z, drawn 
from a Gaussian distribution with mean 1 — s and standard deviation 0.1. Black line: bidirectional motifs, Grey line: unidirectional motifs. D The same 
as C but with pruning parameter a = 0.4. 
doi:1 0.1 371 /journal.pone.01 00805.g005 



case of bidirectional motifs i.e. pairs of the form (x, x), the 
symmetry measure will result in s= 1. By inverting Eq. 3, we can 
derive the mean value for connection pairs fi z = E n [Zi c ] = 1 — fi s . 
We can use now this value to define connection pairs in a network 
as unidirectional or bidirectional: if Z/ C >fi z than is a 
unidirectional motif, otherwise it is a bidirectional motif. In this 
way we relate unidirectional and bidirectional motifs to what is 
traditionally called single edge motif and second-order reciprocal 
motif, respectively. It is then expected that when s increases, the 
fraction of bidirectional motifs increases towards 1 , whereas the 
percentage of unidirectional motifs decreases towards 0. 

We show this relation in simulations by generating 10 3 networks 
of 15 neurons each, with uniformly distributed random connec- 
tions in [0, 1] and no pruning. In this case the mean value of the 
symmetry measure is I*" — 0.614. Using Eq. 3, we have 
^2 ~ 0.386, which is the value used to decide whether a 
connection pair is unidirectional or bidirectional. For each of 
these networks, we calculated the value of the symmetry measure 
and the fraction of unidirectional and bidirectional motifs and we 
plotted the results in Fig. 5A as a scatter plot (black circles - 
bidirectional motifs, grey circles - unidirectional motifs). Also, un 
Fig. 5B we show the analogous results obtained when we prune the 
connections with a = 0.4. In both cases, a linear relation between s 
and motifs is evident. 

Note that in both figures the restricted domain on the s-axis: this 
is determined by the range of s values that correspond to random 
networks. If we want to extend this range, we need to consider 



networks that are not random any more. We achieve this by fixing 
a distribution for connection pairs Z. Once we decide on the 
desirable value of s, in our case the whole zero to one spectrum, 
we can use a distribution (e.g. Gaussian) with mean p. z = \— \i s 
and a chosen variance to draw the values of all the connection 
pairs in the network. Following this procedure, we fill the upper 
triangular part of the 15x15 weights matrix with random values 
from the uniform/ Gaussian distribution, and derive the other half 
of the weights by inverting the definition of Z. As a PDF(Z) we 
chose a Gaussian distribution around ji z with rj = 0.1, except for 
the extreme cases (near s = 0, s=l) where a = 0. With this 
technique of creating networks, we sampled the entire domain of s 
in steps of 0.01. For each value, we again generated 10 3 networks 
of 1 5 neurons with (half of the) weights uniformly distributed, and 
then we computed the mean value and standard deviation. Results 
are shown in Fig. 5C,D respectively for unpruned and pruned 
(with a = 0.4) networks (black line - bidirectional motifs, grey line - 
unidirectional motifs). We can see that Fig. 5C,D correcdy 
reproduce the linear regime observed in Fig. 5A,B for values of s 
close enough to /i". 

Due to the method by which we generated networks, the shape 
of the distribution of half of the weights does not affect the shape of 
the dependence in Fig. 5C,D. Indeed, if we choose half of the 
connections to be Gaussian-distributed, we will observe only a shift 
in both curves as they have to cross at ^ = 0.885 (results not 
shown). 
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A B 




Figure 6. Eigenvalues and network structure. A Expected value and standard deviation of the fraction of complex eigenvalues as a function of 
the pruning for different types of networks of N= 10 neurons with uniform weight distribution. The total length of each bar is two times the standard 
deviation. Dotted, dark grey line: simulations for asymmetric networks, Dashed, black line: simulations for random networks, Dash-dotted, light grey line: 
simulations for symmetric networks. B Fraction of complex eigenvalues as a function of network size for random networks with uniform weights 
distribution. Pruning parameter a = 0. 
doi:10.1371/journal.pone.0100805.g006 



Symmetry measure and eigenvalues 

In the definition of our symmetry measure we have deliberately 
excluded (0,0) connection pairs. This was a conscious decision for 
mathematical and practical reasons, see Methods. As a conse- 
quence, pairs of the form (0,0) do not contribute to the evaluation 
of the symmetry of the network. Instead, pairs of the form (0,e), 
with £ very small, contribute to the asymmetry of the network 
according to our specific choice of symmetry measure (leading to 
Z = 1, see Methods). Here we further motivate this choice via a 
comparison of our measure to the evaluation of the symmetry via 
the matrix eigenvalues, for three types of networks: (i) symmetric, 
where each connection pair consists of synapses of the same value, 
(ii) asymmetric, where every connection pair has one connection 
set to a small value t, and (iii) random, where connections are 
uniformly distributed. We demonstrate that our measure has a 
clear advantage over the eigenvalues method, in particular when 
pruning is introduced. This difference in performance lays in the 
different ways that (0,0) and (0,e) are treated by our measure. 

A crucial property of the real symmetric matrices is that all their 
eigenvalues are real. Fig. 6A depicts the fraction of complex 
eigenvalues vs the pruning parameter a for a symmetric (dash- 
dotted, light grey line) asymmetric (dotted, dark grey line) and 
random (dashed, black line) matrix with uniformly distributed 
values, similar to Fig. 3A, with the same statistics (10 5 networks of 
10 neurons). As expected, if no pruning takes place (a = 0), 
symmetric matrices have no complex eigenvalues and are clearly 
distinguishable from random and asymmetric matrices. On the 
contrary, both random and asymmetric matrices have a non-zero 
number of complex eigenvalues, which increases with a higher 
degree of asymmetry, leading to a considerable overlap between 
these two cases, differendy from what happens with our measure 
in Fig. 3A. 

As we introduce pruning, the mean of the complex eigenvalues 
of the three distinctive types of network moves towards the same 
value, an increase for the symmetric network and decrease for the 
random and non-symmetric networks. This is expected as pruning 
specific elements will make the symmetric network more 
asymmetric while it will increase the symmetry of the asymmetric 
network by introducing pairs of the form (0,t) or (0,0). The (0,e) 
pairs are due to the construction of the asymmetric network, where 
half of the connections are stochastically set to very low values. 



This continues till a = 0.5, after which further pruning reduces the 
number of complex eigenvalues of all networks: a high level of 
pruning implies the formation of more (0,e) or (0,0) pairs for the 
asymmetric network and more (0,0) pairs for the symmetric 
network. In Fig. 6B we show the dependence of the fraction of 
complex eigenvalues for uniform random matrices on their size. 

Comparing Fig. 6A to Fig. 3A, we observe that our symmetry 
measure offers excellent discrimination between the symmetric, 
asymmetric and random matrices for e.g. a = 0.4. This is despite 
the fact that the structure of the asymmetric matrix per se has 
become less asymmetric and the structure of the symmetric matrix 
has become more asymmetric due to the pruning, as it is 
confirmed by the overlapping fraction of complex eigenvalues for 
asymmetric and random matrices (Fig. 6A). In our measure (0,e) 
pairs are treated as asymmetric, (0,0) pairs are ignored, and the 
bias that pruning introduces is taken into account allowing for 
good discrimination for all types of matrices, even beyond a = 0.4. 

Case study: Monitoring the connectivity evolution in 
neural networks 

We demonstrate the application of the symmetry measure to a 
network of neurons evolving in time according to a Spike-Timing 
Dependent Plasticity (STDP) "triplet rule" [32] by adopting the 
protocols of [18]. These protocols are designed to evolve a network 
with connections modified according to the "triplet rule", to either 
a unidirectional configuration or bidirectional configuration, with 
the weights being stable under the presence of hard bounds. We 
have deliberately chosen a small size network as a "toy-model" 
that will allow for visual inspection and characterisation at the 
mesoscopic scale. 

We simulated N = 30 integrate-and-fire neurons (see Methods 
section for simulation details) initially connected with random 
weights w« e [0, 1] drawn from either a uniform (Fig. 7) or a 
Gaussian (Fig. 8) distribution (see Table 1 for parameters). Where 
a pruning parameter is mentioned, the pruning took place prior to 
the learning procedure: with a fixed probability some connections 
were set to zero and were not allowed to grow during the 
simulation. 

Our choice allows us to produce an asymmetric or a symmetric 
network depending on the external stimulation protocol applied to 
the network. Since the amplitude of the external stimulation we 
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Frequency-based protocol Sequential protocol 




Presynaptic neuron Presynaptic neuron 

Figure 7. Evolution of networks with STDP and initially uniform weights distribution. A Time evolution of the symmetry measure when a 
frequency protocol is applied on a network, shown as average over 50 representations. The shaded light grey areas represent the standard deviation 
(the total length of height of each band is twice the standard deviation). Solid black line: no pruning, Dashed grey line: with pruning a = 0.4. B Example 
of an adjacency matrix at the end of the learning process for a network with the frequency protocol and no pruning. For this example s~ 0.921. C The 
same as B but with pruning a = 0.4. For this example ,?~0.427. D, E, F The same as A, B and C but with the sequential protocol applied. The 
connectivity matrix in panel E has .?~0.393. The connectivity matrix in panel F has .? ~ 0.141 . 
doi:1 0.1 371 /journal.pone.01 00805.g007 



chose (of xt = 30mV) is large enough to make a neuron fire every 
time it is presented with an input, the firing pattern of neurons 
reflects the input pattern and we can indifferently refer to one or 
another. The asymmetric network has been obtained by using a 
"sequential protocol", in which neurons fire with the same 
frequency in a precise order one after the other, with 5 m s delay, 
see also [18]. The symmetric network is produced by applying a 
"frequency protocol", in which each neuron fires with a different 
frequency from the values {15, 16, 17,..., 44 Hz}. In both 
cases, the input signals were jittered in time randomly with zero 
mean and standard deviation equal to 2% of the period of the 
input itself for the frequency protocol, to 25% of the delay for the 
sequential protocol. Depending on the protocol, we expect the 
neurons to form mostly unidirectional or bidirectional connections 
during the evolution. 



The time evolution for both protocols and initial distributions is 
shown in Figs 7A,D (uniform) and 8A,D (Gaussian). Each panel 
represents the evolution of the symmetry measure averaged over 
50 different representations for both fully connected networks 
(a = 0, solid black line) and pruned networks (e.g. a = 0.4, dashed 
grey line). The shaded area represents the standard deviation. The 
time course of the symmetry measure can be better understood 
with the help of the Fig. 3. At the beginning, the values of s reflect 
what we expect from a random network. Afterwards, as the time 
passes, the learning process leads to the evolution of the 
connectivity. As expected, the frequency protocol induces the 
formation of mostly bidirectional connections, leading to the 
saturation of s towards its maximum value, depending on the 
degree of pruning. On the other hand, when we apply the 
sequential protocol, connection pairs develop a high degree of 
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Figure 8. Evolution of networks with STDP and initially Gaussian-distributed weights. A Time evolution of the symmetry measure when a 
frequency protocol is applied on a network, shown as average over 50 representations. The shaded light grey areas represent the standard deviation 
(the total length of height of each band is twice the standard deviation). Solid black line: no pruning, Dashed grey line: with pruning a = 0.4. B Example 
of an adjacency matrix at the end of the evolution for a network with frequency protocol and no pruning. For this example s~ 0.963. C The same as B 
but with pruning a = 0.4. For this example s ~ 0.456. D, E, F The same as A, B and C but with the sequential protocol applied. The connectivity matrix 
in panel E has .s~0.426. The connectivity matrix in panel F has .s~0.153. 
doi:1 0.1 371 /journal.pone.01 00805.g008 



asymmetry, the values of s decreasing towards its minimum. 
Connections were constrained to remain inside the interval [0, 1]. 

The final connectivity pattern can be inspected by plotting the 
adjacency matrix W . In Fig. 7B,C and 8B,C we give an example 
of W at the end of the evolution for one particular instance of the 
50 networks when the frequency protocol is applied. Similarly, in 
Fig. 7E,F and 8E,F we show the results for the sequential protocol. 
The corresponding values of s for each of the examples in the 
figures are listed in Table 3. In the case that a = 0, a careful 
inspection of Fig. 7B, 8B indicates that connectivity is bidirection- 
al: all-to-all strong connections have been formed. On the other 
hand, In Fig. 7E, 8E, trying to determine if there is a particular 
connectivity emerging in the network starts to be considerably 
tough. However, by using our symmetry measure (see values in 
Table 3) we can infer that the connectivity is unidirectional. In the 
pruned networks, however, see Fig. 7C, 8C and Fig. 7F, 8F, the 



formation of bidirectional and unidirectional connection pairs is 
not as obvious as for a = 0. We therefore refer again to the Table 3 
and compare the values of s with n™ nd and with fi" sym or /if", 
depending on the case. We can then verify that the learning 
process has significantly changed the network and its inner 
connections from the initial random state. 

We can rigorously verify the above conclusions via a statistical 
hypothesis test such as the /(-value test, which in essence quantifies 
how far away the value of our symmetry measure s of our final 
configuration is from the initial, random configuration (see also 
Methods). In Table 3 we show the ^-values corresponding to the 
null hypothesis of random connectivity for the examples in the 
Fig. 7, 8. Once we set the significance level at ^, = 0.05, we can 
verify that, except for the case of pruned network with initially 
Gaussian-distributed connections where a frequency protocol has 
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Table 3. Symmetry measure and p-value for different types of network. 



Type 


S 




p-value 




UFa 0 


0.921 


0.614±0.042 


1.82 x 10" 13 


1.000 ±0.000 


UFao.4 


0.427 


0.263 ±0.058 


4.50 x 10~ 3 


0.429 ±0.081 


USoo 


0.393 


0.614 + 0.042 


1.21 x 10" 7 


0.003 ±0.387 x 10- 3 


USflo.4 


0.141 


0.263 ±0.058 


3.46 x 10- 2 


0.001 ±0.352 xlO- 3 


GF«o 


0.963 


0.885±0.013 


3.30 x 10-' 


1.000 ±0.000 


GFao.4 


0.456 


0.379±0.072 


2.85X10 -1 


0.429 ±0.081 


GSa 0 


0.426 


0.885±0.013 


0 


0.002±0.256x 10~ 3 


GSao.4 


0.153 


0.379±0.072 


1.70 x 10~ 3 


0.001 ±0.260 x 10- 3 



Column 7. Network type. U = Uniform distribution, G = Gaussian distribution, F = Frequency protocol, 5 = sequential protocol, a 0 = No prune, « 0 .4 = pruning of 0.4. 
Column 2. Value of the symmetry measure for one instance of each type. Column 3. Results from the previous statistical analysis on random networks. Column 4. 
Corresponding p-value from Eq. 38. Column 5. Results from the previous statistical analysis for the corresponding closest extreme case - symmetric network for 
frequency protocol and asymmetric network for sequential protocol, s means symmetric and a asymmetric. 
doi:l 0.1 371 /journal.pone.01 00805.t003 



been applied (i.e. GFao.4) 5 the /7-values are significant, implying 
the rejection of the null hypothesis. This is also justified by Fig. 3A, 
B: when we increase the pruning, the mean value of the symmetry 
measure of the fully symmetric network approaches that of the 
pruned random network and in particular for the case where the 
weight are randomly Gaussian-distributed. 

Summary 

The study of the human brain reveals that neurons sharing the 
same cognitive functions or coding tend to form clusters, which 
appear to be characterised by the formation of specific connec- 
tivity patterns, called motifs. We, therefore, introduced a 
mathematical tool, a symmetry measure s, which computes the 
mean value of the connection pairs in a network, and allows us to 
monitor the evolution of the network structure due to the synaptic 
dynamics. In this context, we applied it to a number of evolving 
networks with plastic connections that are modified according a 
learning rule. After the network connectivity reaches a steady state 
as a consequence of the learning process, connectivity patterns 
develop. The use of the symmetry measure together with the 
statistical analysis and the p-value test allow us both to quantify the 
connectivity structure of the network, which has changed due to 
the learning process, and observe its development. It also allows 
for some interesting observations, (i) Introducing a fixed amount of 
pruning in the network prior to the learning process biases the 
adjacency matrix towards an asymmetric configuration, (ii) A 
network configuration that appears to be symmetric under the 
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